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Introduction 


The need to empirically determine which combination of lecture, discussion, 
highly structured, loosely structured or direct-indirect oriented teaching pro- 
duces optimum student growth in science classes has been recognized by researchers 
such as 0. Roger Anderson (1971) but has been actively pursued by very few. 
Undoubtedly, there are many reasons for this. Certainly the accessibility of the 
proper statistical procedures and computing equipment can pose problems to the 
researcher but the reasons may be more philosophical. Researchers have been 
drawn in large numbers toward establishing the superiority cf one program over 
another and have not asked or tried to determine at what point or level features 
such as teacher use of inquiry interaction strategies, laboratory based acti- 
vities and open-ended investigations produces greater student knowledge of, and 
more positive attitudes toward, the subject. They have also failed to ask if 
further increases in the use of such procedures lead to decreased subject matter 
growth and less favorable attitudes. These ideas are considered in the following 
paper. First, there is a brief summary of how optimization theory has been 
considered by educators and then a description of a study to Empirically Determine 


Which Instructional Procedure. roduce Optimuni Student Growth. 


Optimization Theory and Science Education 


The mathematicians Wilde and Beightler (1967) have described optimization 
as a theory which encompasses the quantitative study of optima and methods of 
finding them. The statisticians Bellman and Dreyfus (1962, p. 15) give the 
following definition: 

An optimal policy has the property that whatever the initial state 

and initial decision are, the remaining decisions must constitute 

an optimal policy with regard to the state resulting from the first 

decision. 

“Optimization theory is now being applied in fields as diverse as biology 
(Rosen, 1967 and 1971), psychology (Cronbach and Gleser, 1965) and engineering 
(Aris, 1961). In education, however, optimization theory has received only 
passing attention and the terms optimizing, optima and optimum are used in a 
somewhat confusing fashion in at least two ways: one mathematically rigorous; 
the other more informal but perhaps more relevant to current educational re- 
search practices. A feeling for the range in definition and usage in education 
is perhaps best achieved with reference to two papers; one called "Models for 
Optimizing the Learning Process" by Groen and Atkinson (1966), and another 
titled "Optimum Teacher-Pupil Interaction for Pupil Growth by Robert S. Soar 
(1968). 

In the more mathematically rigorous of the two papers, Groen and Atkinson 
(1966) outline a common instructional paradigm concerning programmed learning 
and suggest a notation which allows the paradigm to be restated as a multi-stage 
decision process with an explicit mathematical learning model embedded in it. 


They applied these procedures in an effort to avoid research techniques which 
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led many other workers investigating programmed learning to insignificant and 
conflicting results. Basically, these workers had two goals: 1) to provide 

an explicit statement of the problems of optimal instruction in the framework 
of multi-stage decision theory and, 2) to indicate, using dynamic programming 
as an example, how optimization problems can be solved 1, practice (Groen and 
Atkinson, 1966). 

By contrast, Soar (1968) used data from interaction analysis research and 
pupil attitude and content changes in a way which allowed non-linear or curvi- 
linear relationships to be identified, if they existed. He is, then, one of 
the first researchers in education to employ optimizing principles to class- 
room observation data. Optimum as used by Soar and in this study is defined 
through the se of polynominal regression analysis using the BMD O5R computer 
program (Dixon, 1968). (This program plots successfully higher degree equa- 
tions and computes an F value for each.) Soar apparently did not derive his 
hypothesis directly from the mathematical concepts of optimization but rather, 
was influenced by the learning psychologists’ Castaneda, McCandless and Palermo 
(1965) who had previously found evidence supporting non-linear relationships 
between learning and anxiety levels in children. 

Soar's data supporting non-linear relationships was collected during an 
extensive study of fifty-four classrooms, grades three through six, in four 
elementary schools in Central South Carolina over a two year period. The re- 
suits he ootained from the initia! analysis in this study were difficult to 
interpret, especially when only simple linear regression lines were used. This 
led him to re-analyze the data in search of the optimal relationships. The 
results of the re-analysis using a BMD (Biomedical Computer Program) 


O5R Polynominal Regression program (Dixon, 1965) specifying the fitting of a 


) 


two-degree polynominal are most succinctly summarized by the graph which follows: 


FIGURE 1: Teacher Indirectness Related 
to Pupil Growth 
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He also beiieves his results indicate that the effective teacher must be able 
to shift style as he shifts objectives (Soar, 1968, p. 278). He suggests that 
direct control and a non-supporting climate (as measured by Flanders) induce 
stress on the pupil and that optimum level of stress or anxiety shifts as the 
task complexity changes. In another study Coates (1966) found similar relation- 
ships between pre and post attitude data and degree of teacher acceptance (as 


measured in Flanders' category 3-3). 


An Investigation to Empirically Determine Which Instructional 
Procedures Produce Optimum Student Growth 


The primary objective of this study was to empirically determine which com- 
bination of lecture, discussion or direct-indirect oriented teaching produce opti- 
mum Student growth. The study involved the search for statistically significant 
linear and curvilinear (optimal) relationships between assessed student percep- 
tions about classroom instructional procedures and pre-post test changes in 
student 1) understanding of science concepts and processes, 2) attitudes toward 
science and scientists and 3) development of interest in science as a classroom 
subject. A secondary objective was to develop an instrument to assess student 
perceptions of ard attitudes toward the frequency with which teachers use a 
variety of instructional moves and techniques. 

Methodoiogy and Design 

Nineteen teachers and thirty-eight science classes (two for each teacher) 
were involved in the stud. All teachers were participants in a NSF sponsored 
College School Cooperative Science Earth Science proaram (CCSSP) conducted for 
teachers from the north central Ohio region. This study was part of a compre- 
hensive research plan which included the administration of several instruments 
in a pre-post test design during the academic year. Data was collected using: 
A) concept-process tests, B) the Science Classroom Checklist (SCACL), C) the 
Silance and Remmers Interest Scale and D) an instrument to measure student at- 
titudes toward Science and Scientists (BATSS). As part of this evaluation program, 
Disinger (1971) studied (1) the relationships that existed among student cogni-~ 
tive and affective areas as related to a number of teacher variables and (2) 


the relationships among class characteristics and student and criterion variables. 
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The developed Instructional Activities Instrument was piloted and then ad- 
ministered near the end of the year. The decision to develop an instrument to 
measure student attitudes toward, and perceptions of, the frequency with which 
teachers use certain instructional procedures was spurred by the need for an 
instrument which would: 

1) be based upon the theories used in interaction analysis observation 

classification systems: this would allow some comparisons between this 

and interaction analysis studies such as those completed by Coates (1968). 

2) be workable: some of thc questions raised might have been answered 

after collecting extensive interaction analysis data but it would have 

been impossible to do this for 38 classes scattered over a wide geo- 
graphic area. 

3) be able to assess the complex interrelationships between student 

attitudes and perceptions: no instrument existed to measure these re- 

lationships. 

The developed instrument contained paired perception and attitude items. 
The conceptual basis for the perception items was built around the discussion 
of instructional strategies by Hough and Duncan (1970). These workers describe 
four basic instructional strategies: 1) interactive strategies, 2) independent 
strategies, 3) direct strategies, and 4) group strategies. This conceptual frame- 
work was selected because of Hough and Duncan's detailed description of moves and 
tactics and the way these are built into strategies. 

A parallel "paired" attitude item was constructed for each perception item. 
These items were designed so that the student could select one distracter along 
a five point continuum ranging from "more often than he (the teacher) does now" 
(distracter "1") to "as often as he (the teacher) does now" (distracter "3") to 
"not as often as he (the teacher) does now" (distracter "5"). 

This somewhat unorthodox design was devised because of the investigator's 


feeling that educational researchers have too frequently reduced data collecting 


instruments to simplistic either, ‘r dichotomies which fail to reflect the intricate 
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complexities of the instructional situation. Relationships between pupil out- 


comes, teacher behaviors and instructional strategies are best viewed in a rela- 
tivistic framework (in this instrument the student's response on the attitude 
item is given relative to his response on the perception item). 

Scoring on this instrument was accomplished in a way which allowed a 
direct-indirect score to be determined from student responses in each of the 
thirty-eight classes involved. The direct/indirect score was then compared with 
corresponding pre-post change scores as measured by each of the other instruments 
used to assess student growth. A brief description of each of the instruments 
used to collect this data is given below: 

Concept-Process 

An instrument designed to measure major science concepts and processes was 
developed by Disinger (1971) around the seven basic conceptual and the five major 
items in the processes of science identified by the National Science Teachers 
Association (1964). 

Science Classroom Activity Checklist (SCACL) 

SCACL is a modified form of the Kochendorfer and Lee checklist (Kochendorfer, 
1967). Sagness (1970) extensively used this instrument with pre-service science 
education students at The Ohio State University. Two forms of the instrument were 
used in this study: a teacher form and a student form. 

Scale for Measuring Attitude Toward Any School Subject (Interest Scale) 

In 1934 Silance and Remmers developed a forty-five item scale to measure 
attitude toward school subjects. Later, (Remmers, 1970) developed a seventeen 
item form to measure attitude toward any school subject. This was modified 


slightly so that it referred specifically to the scienze classrooms in this study. 


The Beliefs and Attitudes Toward Science and Scientists (BATSS) 


BATSS were measured using a modified form of an instrument developed by 
Champlin (1970). Champlin was concerned with testing student beliefs and at- 
titudes toward science and scientists. He accomplished this by developing a 
thirty-three item belief and thirty-three item evaluative scale. Scoring on the 
belief items was detemined by the nuniber of "correct" responses to the belief 
items while belief and evaluative items were paired. In order to obtain an at- 
titude score, a simplified scoring system was .later developed by Disinger (1971) 
during the present study. 

Data collected with these instruments was used in the analysis with the 
BMD O5R Polynominal Regression program to see if optima existed and to determine 
if significant linear or curvilinear relationships could be found. On the first 
run, the program was set to compute F values for first, second, third, and fourth 
degree equations, then re-run so a computer drawn graph would be produced showing 
the best fitting line. Attitude and perception scores were also compared using 
the BMD O5R Polynominal Regression program and the results used to tentatively 
identify "fragile" and "durable" instructional moves and techniques. 

Results and Conclusions 

In the first phase of the analysis, seven tests were made comparing the 
teacher direct-indirectness score as computed from the Instructional Activities 
Instrument with student growth variables as measured by pre-posttest change 
scores on several instruments. These tests were made with the BMD O5R Polynominal 
Regression Program and although the results did not show a significant curvilinear 
relationship, a significant (p = .05) linear relationship between student attiti -2 
toward the subject as measured by the Silance and Remmers Scale and teacher 


direct-indirectness was found. This information is summarized in Table I] and 
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on figures 2 through 8 in the appendix of this paper. 


TABLE I 
POLYNOMINAL REGRESSION ANALYSIS COMPARING THE 


COMPUTED I/D SCORES FOR EACH CLASS WITH THE 
CHANGE SCORES 


Pearson Product 


Moment 

Best Fitting Line F Value Correlation 
Variables Degree of Equation) to Enter Coefficient 
Concept 3rd 0.64 0.0617 
Process Ist 2.79 0.2683 
Concept-Process Ist 1.62 0.2077 
SCACL 3rd 0.86 0.0370 
Attitudes (BATSS) Ist 1.05 0.1684 
Beliefs (BATSS) Ist 1.54 0.2031 
Interest Ist 4.15" 0.3215 


n = 38 classes 
*p-= 05 
**p—— 10 
The second phase of the analysis involved using the BMD O5R Polynominal 

Regression Program to identify the nature of the relationship which existed be- 
tween the fifteen paired perception and attitude items. The results of some of 
these tests are summarized in Table II. This table was constructed by ranking 
the item pairs based upon the Pearson Product Moment Correlation Coefficient on 
the "more" tests. This was done in order to gain further insight into the com- 
plex relationships which exist between the paired perception and attitude items. 
In this table, the fragile items occur at the top while more durable instructional 


moves and techniques are found at the bottom. Here fragile and durable refer to 
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TABLE II 


INSTRUCTIONAL MOVES AND TECHNIQUES RANKED 
ACCORDING TO CORRELATION COEFFICIENTS: "MORE" 


Pearson 
Mean Product 
Frequency of Moment 
Paired Hypothesis Perception Correlation Description of 
Items Number Item* Coefficient Item 
25 x 26 I-M 1.50 -0.5688 filmstrips 
ie ae I-A 2,05 -0.5392 student inter- 
action 
discussion 
27 x 28 I-N 1.40 -0.3423 films, movies 
19 x 20 I-J 1.03 -0.2673 carrels, booths 
3 x 4 1-B 2.40 -0.2579 reflecting 
questions 
15 x 16 I-H 2.24 -0.2414 — working from 
textbook 
23 x 24 I-L 2.09 -0.2332 step-by-step 
direction in 
lab 
5 x 6 I-C 3.03 -0.2161 general 
questions 
21 X22 I-K* 2.51 -0.1133 lecturing 
TT & 12 I-F* 1.80 -0.0395 independent 
student work 
7x8 I-D* 2.16 -0.0270 specific 
questions 
9x 10 I-E 2.26 +0.0407 discussion, 
debate 
29 x 30 1-0* 1.14 +0.2001 direct answers 
to student 
questions 
17 x 18 I-I 1.25 +0.2096 contracts 
13 x 14 I-G 1.29 +0.2925 reference 
materials 


*These items had insignificant optimal relationships (the F value was 
highest for a second, third, or fourth degree equation). 
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the ability of the described instructional move or techniques in the item to be 


used very frequently while still retaining favor with the students. 

Findings in this portion of the study suggest that certain instructional 
procedures are "fragile" and rapidly lose favor with students if used frequently 
by the teacher, while others are more "durable" and can be used frequently while 
retaining positive student opinion. Among the fifteen instructional techniques 
and procedures described on the Instructional Activities Instrument, the use of 
filmstrips, discussion and debate, and films or movies were more "fragile" than 
the others. 

Discussion and Conclusions 

The techniques used in this study illustrate one way data can be collected 
and statistically analyzed so researchers can look beyond simple linear corre- 
lations in order to determine if curvilinear (optimal) relationships exist. The 
design also includes a procedure for collecting and quantifying student perceptions 
and attitudes about the frequency with which certain instructional procedures are 
used instead of leaving these decisions entirely to teachers and curriculum de- 
signers. 

In this study an optimal relationship was said to exist when a significant 
second, third, or fourth order equation was identified by the BMD Polynominal 
Regression Program. This, of course, constitutes an operational definition of an 
optimum procedure. This definition provided an excellent way to test hypothesis 
but other statistical procedures may hold equal potential. Education data is 
often scattered (see figures 2-8) and even in a comprehensive study such as 
this where 38 classrooms and 19 teachers were involved, there is naturally 
some concern about the effect of one or two spurfous points on curvilinear 


lines. In this study the BMD O5R program was employed more than 50 times. This 
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included the seven plots of I/D scores and student growth measures included in 
the appendix and more than 45 tests of the interrelationships between attitude 
and perception items. Second, third and fourth order equations were frequently 
found to best fit the data, but F values were generally low. A secondary out- 
come, however, was the procedure used to tentatively identify "fragile" and 
"durable" instructional procedures. This technique is also an optimizing pro- 
cedure and may be considered as an alternative way to empirically determine 


optimimum relationships. 
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Figure 2 


Figure 3 


Figure 4 


Figure 5 


Figure 6 


Figure 7 


Figure 8 
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APPENDIX 


1/D SCORE AND GROWTH VARIABLES 
PRODUCED USING THE 
BMD O5R POLYNOMINAL REGRESSION PROGRAM 


Polynominal regression plot of I/D scores and pre-posttest change 
scores of student understanding of science concepts. 


Polynominal regression plot of I/D scores and pre-posttest change 
scores of student understanding of science processes. 


Polynominal regression plot of I/D scores and pre-posttest change 
scores ot student understanding of science concepts and process. 


Polynominal regression plot of I/D scores and student pre-posttest 
change scores on SCACL. 


Polynominal regression plot of I/D scores and pre-posttest change 
scores of student attitudes toward science. 


Polynominal regression plot of I/D scores and pre-posttest change 
scores of student beliefs toward science. 


Polynominal regression plot of I/D scores and pre-posttest change 
scores on Silance and Remmers Interest Inventory. 
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Pre-posttest change scores of student understanding 


of science processes. 
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Student pre-posttest change scores on SCACL. 
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